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DATA EMBEDDING WITH MULTI-LEVEL SCREENING 
Inventor: Anoop K. Bhattacharjya 

BACKGROUND OF THE INVENTION 

Field of the Invention 

5 The present invention relates to a method/algorithm for embedding data in 

color/grayscale digital data. The method/algorithm of the present invention, which 
enables fast data embedding, may be embodied in an apparatus such as a computer, 
or as a program of instructions (e.g., software) embodied on a machine-readable 
medium. 

10 Description of the Related Art 

Digital data embedding refers to the addition of information content to a 
digital medium. Mathematical techniques that operate at the constructive level of 
the particular media are typically employed to add the information. The digital 
medium can take any of a variety of forms, including still digital data, audio and 

15 video. Among those forms, digital media includes various sub-categories: image, 
graphics, text, mixed mode, etc. 

The added information content can be used for different purposes, such as to 
prevent tampering with the image, to identify ownership or the intended recipient 
of a digital image, or to detect tampering of a digital medium. What additional 

20 information is embedded and the manner in which it is embedded depend to a large 
extent on the purpose for which the embedded data will be used, but the basic 
embedding technique has been substantially the same. That is, previous data 
embedding methods have focused primarily on embedding data by adding a small 
signal to the original image data. The present invention provides a different 

25 approach to data embedding. 

OBJECTS OF THE INVENTION 

Accordingly, it is an object of the present invention to provide an 
algorithm/method to achieve data embedding by switching between screens of a set 
of multi-level screens or quantizers. 

patappAF Express MaU Label No. EV311301716US 

Customer No. 20178 i 



AP166TP 

It is a further object of this invention to enable the algorithm/method to tune 
each screen, during the data embedding process, to maximize the quahty of the 
image on the intended display medium, so that the quality of the image does not 
suffer. 

5 SUMMARY OF THE INVENTION 

According to one aspect of this invention a method for embedding data in an 
input digital medium is provided. The method generally comprises (a) generating a 
set of multi-level screens, each multi-level screen being generated by selecting a set 
of colors that comprise the colors that can be output by that multi-level screen; (b) 
10 screening the input digital medium with the generated multi-level screens using a 
dither matrix and a set of level matrices; and (c) selecting, for each of select number 
of pixel locations in the input digital medium, one of the level matrices, based on a 
message symbol to be embedded at that pixel location, to create an output, thereby 
embedding data in the input digital medium. 

15 Preferably, the multi-level screen is generated such that, for a single color, 

c color levels are selected to form an ordered set such that c„ < c^^, . Moreover, the 
generating of each multi-level screen preferably comprises determining an output 
color corresponding to an input color c at a given pixel location in the input digital 
medium by finding an index r such that <c<c^^i, and performing one of the 

20 following steps. (1) Outputting c^, if c<c^\ (2) outputting c^_i, if c>c^_^ \ or (3) 
computing t = {c- c^)/{c^^, - c J, if < c < c^_, . If step (3) is performed, then it is 
determined if t < rf„ n.od p,v mod g • If so, the method involves outputting ; if not, the 
method involves outputting c^^^ . Here, M represents the number of levels of that 
multi-level screen, D = [rf,^] denotes the dither matrix and PxQ defines its size, 

25 and (w,v) identifies a location in the input digital medium. 

Preferably, the level matrix used to create the corresponding output for each 
selected pixel location in the input digital medium is determined independently or 
as a function of the neighboring input and output colors. 
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In another aspect, the invention involves an apparatus for embedding data in 
an input digital medium. Such an apparatus comprises components appropriately 
configured to perform the processing described above with respect to the method. 
Such components may include one or more of the following: an instruction-based 
5 processor (e.g., a central processing unit (CPU)), an Application Specific Integrated 
Circuit (ASIC), digital signal processing circuitry, or combination thereof. 

In accordance with further aspects of the invention, the above-described 
method or any of the steps thereof may be embodied in a program of instructions 
(e.g., software) which may be stored on, or conveyed to, a computer or other 
10 processor-controlled device for execution. Alternatively, the method or any of the 
steps thereof may be implemented using functionally equivalent hardware (e.g., 
ASIC, digital signal processing circuitry, etc.) or a combination of software and 
hardware. 

Other objects and attainments together with a fuller understanding of the 
15 invention will become apparent and appreciated by referring to the following 
description and claims taken in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a flow diagram illustrating the basic processing steps of a 
algorithm/method for embedding data in a digital medium, according to 
20 embodiments of the invention. 

Fig. 2 is a representation of a dither matrix designed in accordance with 
embodiments of the invention. 

Fig. 3 is a flow diagram illustrating the design of a single-color multi-level 
screen, according to embodiments of the invention. 

25 Fig. 4 is a schematic representation of an input image in which data may be 

embedded in accordance with embodiments of the invention. 

Fig. 5 is a set of level matrices, constructed in accordance with embodiments 
of the invention. 
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Fig. 6 is a schematic diagram of two level matrices with non-overlapping 
outputs. 

Fig. 7 is a specific set of level matrices (i.e., a set of multi-level screens), 
constructed in accordance with an embodiment of the invention. 

5 Fig. 8 is a block diagram of an exemplary image processing system which 

may be used to implement embodiments of the algorithm/method of the present 
invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A. The Method/Algorithm 

10 Referring to the flow diagram of Fig. 1, the algorithm/method of the present 

invention is generally involves the following. First, a set of multi-level screens is 
generated (step 101). Each such screen is generated by selecting a set of colors that 
comprise the colors that can be output by that multi-level screen. Next, an input 
digital medium (e.g., a digital input image) is screened with the generated multi- 

15 level screens using a dither matrix and a set of level matrices (step 102). Then, for 
each of a select number of pixel locations in the input digital medium, one of the 
level matrices is selected, based on the message symbol to be embedded at that 
pixel location, to create an output (step 103). The input digital medium then 
contains embedded data in the form of message symbols embedded at the selected 

20 pixel locations. The selected number of pixels may be all of the pixels or a smaller 
subset- 

B. Multi-Level Screening 

A specific design of a multi-level screen is presented, by way of example, to 
demonstrate the various aspects of the invention. Referring to Fig. 2, consider a 
25 two-dimensional spatial array of thresholds forming a PxQ dither matrix 21, 
denoted D = [rf,^] . Without loss of generality, assume that d^^ e [0,l]. This dither 
matrix 21 may be designed based on characteristics of an output device, e.g., a 
printer, using known techniques such as clustered, ordered, dispersed dithers, etc. 
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A single-color multi-level screen with M levels is designed to function as 
shown in the flow diagram in Fig. 3. The design starts by choosing a set of Af 
colors, {c^ : w = 0,...,M -l}, that comprise the colors output by the screen (step 301). 
For a single color, the levels can be chosen to form an ordered set such that 
5 c„ < . Without loss of generality, all colors are assumed to lie in the interval 
[04]. The output color corresponding to a color c at image location (e.g., pixel 
location) (m,v) (see Fig. 4) is determined as follows. Find an index r, such that 
c^<c< c^^i (step 302). In step 303, determine if c < Cq . If so, output (step 304). 
If not, determine in step 305 if c > c^_i . If so, output c^.^ (step 306). In all other 
10 cases, that is, if the decision in step 305 is **no," compute t = {c- cj/(c^^i - in step 
307. Next, in step 308, determine if t<d^^p^^Q, If so, output c,(step 309); 
otherwise, output c^+i (step 310). 

C. Creating a Set of Multi-Level Screens 

A schematic representation of an input image 41 is shown in Fig. 4. Multi- 
15 level screens, as described above, can be used to screen such an input image 41 by- 
using single dither matrix 21, D^[d.j]y as shown in Fig. 2, together with a set of 

level matrices 51, denoted C ={^1 : w =0,...,M -l] and schematically illustrated in 
Fig. 5. At each image location (e.g., pixel location) 42, designated (m,v), the level 
matrix C to be used to create the output may be chosen independently or as a 
20 function of the neighboring input and output colors, using color-prediction 
functions, or schemes such as error diffusion. 

D. Using a Set of Multi-Level Screens for Data Embedding 

If the level matrices C are designed to have non-overlapping outputs, the 
level matrix used to generate the output at a given pixel location can be determined 
25 uniquely by examining the output color. For example. Fig. 6 shows two different 
level matrices, say and C^, each having 3 color output levels between 0 and 1, 
i.e., M = 3. The output levels of do not overlap those of C^ For , those levels 
are indicated by , cl and . For , those levels are indicated by Cq , cf and cl . 
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For a given input color 61 that lies between c* and cj in level matrix C^ a dither 
matrix 21 is applied between those two color levels. The same or a different dither 
matrix 21 is also applied between and cf which defines the interval in which 
input color 61 lies. By examining the output color corresponding to input color 61, 
5 the particular level matrix C* or used to create that output color can be 
determined. 

Specifically, for an output color c , the matrix C can be found by determining 
which cl is equal to c. If the minimum separation between the colors c'^ is d^, the 
above scheme would also be able to tolerate noise of up to dJ2^ and still correctly 

10 determine C by finding the that is closest to the noise-corrupted output color c . 
Thus, given N such level matrices C , it is possible to embed and recover one 
N -ary message sjmabol at each pixel location. The mapping between C and input 
symbols can be changed at each pixel using a variety of schemes including schemes 
based on a secret key, functions of neighboring pixel values in a causal 

15 neighborhood of the given pixel, etc. 

E. Example 

Fig. 7 shows a set of multi-level screens for embedding a message symbol 
with four (4) alternatives at each location. Assume an 8-bit/pixel input image 
where each pixel may assume one of 256 gray levels. To embed up to four (4) 
20 symbols per pixel, four 64-level matrices C , i= 0,1,2,3, would be required. 
Assuming that colors have been scaled to the interval [0,l], the level matrices may 
be selected to be: 

C = = (4m + /)/ 255 : m = 0,...,63},/ = 0,1,2,3 , as shown in Fig. 7. 

F. Extension to Color 

25 The above scheme can easily be extended to color channels by using the same 

or different dither matrices for each color channel, and picking corresponding level 
matrices. The above-described algorithm/method is thus extended to color by 
replicating the same technique for each color channel. The use of different dither 
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matrices for different color channels can be used to build requirements on the 
relative color-distribution patterns for each channel to minimize the perception of 
artifacts such as Moire patterns, or increased image noise. 

Another technique would be to consider the higher dimensional color space as 
5 a single space, and use different non-overlapping color quantizers to quantize this 
space. Messages may now be embedded by picking different quantizers depending 
on the symbol to be embedded. This scheme, however, does not take into account 
the spatial distribution of colors (as is implicitly done in the design of the dither 
matrix D ), and may result in more visible embedding artifacts. Such effects may be 
10 mitigated using techniques such as color error diffusion, at the expense of increased 
computation. 

G. Implementations 

The algorithm/method of the present invention may be conveniently 
implemented in software which may be run on an image processing system 70 of the 

15 type illustrated in Fig. 8. The image processing system is described below in the 
context of a computer with peripheral devices including a printer. This is but one 
example of an image processing system in which the algorithm of this invention 
may be incorporated. The algorithm may also be embodied in other suitable 
arrangements. For example, the inventive algorithm may be embodied directly in 

20 the printer. The algorithm may also be embodied in a photocopier which includes, 
or has access to, a processing unit. 

The illustrated image processing system of Fig. 8 includes a central 
processing unit (CPU) 71 that provides computing resources and controls the 
system. CPU 71 may be implemented with a microprocessor or the like, and may 
25 also include a floating point coprocessor for mathematical computations. CPU 71 is 
preferably also configured to process image/graphics, video, and audio data. To this 
end, the CPU 71 may include one or more other chips designed specifically to 
handle such processing. System 70 further includes system memory 72 which may 
be in the form of random-access memory (RAM) and read-only memory (ROM). 
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Such a system 70 tjrpically includes a number of controllers and peripheral 
devices, as shown in Fig. 8. In the illustrated embodiment, input controller 73 
represents an interface to one or more input devices 74, such as a keyboard, mouse 
or stylus. There is also a controller 75 which communicates with a scanner 76 or 
equivalent device for digitizing documents. A storage controller 77 interfaces with 
one or more storage devices 78 each of which includes a storage medium such as 
magnetic tape or disk, or an optical medium that may be used to record programs of 
instructions for operating systems, utilities and applications which may include 
embodiments of programs that implement various aspects of the present invention. 
Storage device(s) 78 may also be used to store data to be processed/manipulated in 
accordance with the invention. A display controller 79 provides an interface to a 
display device 81 which may be of any known type. 

In accordance with the invention, a printer controller 82 is also provided for 
communicating with a printer 83, which is preferably a laser printer. The processing 
of this invention may be embodied in the printer controller 82, e.g., the printer driver. 

A communications controller 84 interfaces with a communication device 85 
which enables system 70 to connect to remote devices through any of a variety of 
networks including the Internet, a local area network (LAN), a wide area network 
(WAN), or through any suitable electromagnetic carrier signals including infrared 
signals. 

In the illustrated system, all major system components connect to bus 86 which 
may represent more than one physical bus. 

Depending on the particular application of the invention, various system 
components may or may not be in physical proximity to one another. For example, 
the input data (e.g., the data used in creating the multi-level screens and/or the 
data to be embedded) and/or the output data (e.g., the multi-level screens and/or the 
image data containing embedded data) may be remotely transmitted from one 
physical location to another. Also, a program that implements various aspects of 
the screen design or data embedding process may be accessed from a remote 
location (e.g., a server) over a network. Such data and/or program(s) may be 
conveyed through any of a variety of machine-readable medium including magnetic 
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tape or disk or optical disc, network signals, or any suitable electromagnetic carrier 
signal including an infrared signal. 

While the present invention may be conveniently implemented with software, 
a hardware implementation or combined hardware/software implementation is also 
5 possible. A hardware implementation may be realized, for example, using ASIC(s), 
digital signal processing circuitry, or the like. As such, the claim language 
"machine-readable medium" includes not only software-carrying media, but also 
hardware having instructions for performing the required processing hardwired 
thereon, as well as a combination of hardware and software. Similarly, the claim 

10 language "program of instructions" includes both software and instructions 
embedded on hardware. Also, the "means" language used in the claims covers any 
appropriately configured processing device, such as an instruction-based processor 
(e.g., a CPU), ASIC, digital signal processing circuitry, or combination thereof. 
With these implementation alternatives in mind, it is to be understood that the 

15 figures and accompanying description provide the functional information one skilled 
in the art would require to write program code (i.e., software) or to fabricate circuits 
(i.e., hardware) to perform the processing required. 

As the foregoing description demonstrates, the present invention provides an 
effective method/algorithm for embedding data in a digital medium by switching 
20 between a set of multi-level screens or quantizers. Advantageously, each screen is 
tuned to maximize the quality of the image on the intended display medium, so that 
the quality of the image does not suffer. 

While the invention has been described in conjunction with several specific 
embodiments, many further alternatives, modifications, variations and applications 
25 will be apparent to those skilled in the art that in light of the foregoing description. 
Thus, the invention described herein is intended to embrace all such alternatives, 
modifications, variations and applications as may fall within the spirit and scope of 
the appended claims. 
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